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Summary. We investigate in detail works of Peskir |15| and Meilijson |10| and 
develop a link between them. We consider the following optimal stopping problem: 



oo, where 5* = (St)t>o is the maximum process associated with real valued Brownian 
motion B, (f> £ C 1 is non-decreasing and c > is continuous. From work of Peskir 
|15) we deduce that this problem has a unique solution if and only if the differential 
equation 



admits a maximal solution g»(s) such that g»(s) < s for all s > 0. The stopping 
time which yields the highest payoff can be written as t* = inf{t > : B t < g*(St)}- 
The problem is actually solved in a general case of a real- valued, time homogeneous 
diffusion X — (X t : t > 0) instead of B. We then proceed to solve the problem for 
more general functions (f> and c. Explicit formulae for payoff are given. 

We apply the results to solve the so-called optimal Skorokhod embedding prob- 
lem. We give also a sample of applications to various inequalities dealing with ter- 
minal value and maximum of a process. 
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1 Introduction 

In this paper we study certain optimal stopping problems. Our interest in these 
problems originated from the Skorokhod embedding field and a certain knowledge 
of the latter will be useful for reading (see our survey paper 

We are directly stimulated by an article by Meilijson I10| and our observation 
that his results can be seen via the tools developed by Dubins, Shepp and Shiryaev 
and Peskir I15| . In this paper, we manage to establish a link and generalize both the 
works of Meilijson |10| and Peskir |15|. We try to investigate the nature of the optimal 
stopping problem 11 21 through a series of remarks and rely on reasonings found 
in the above-cited articles together with some approximation techniques and limit 
passages to develop certain generalizations. Our work has therefore characteristics 
of an exposition of the subject with aim at unifying and extending known results. 

Let 4> be a non-negative, increasing, continuous function and c a continuous, pos- 
itive function, and consider the following optimal stopping problem of maximizing 

Vr = E [(/.(Sr) - J c(B s )ds], (1) 

over all stopping times r such that 

c(B a )ds] < oo, (2) 

where (Bt : t > 0) is a real-valued Brownian motion and St is its unilateral maxi- 
mum, S t = SUP u<t By. 

Suppose, in the first moment, that 4>(x) = x and c(x) = c > is a constant. In 
this formulation the problem was solved by Dubins and Schwarz |S] in an article on 
Doob-like inequalities. The optimal stopping time is just the Azema-Yor embedding 
(see Azema and Yor |5j or Section 5 in Obloj jllp for a shifted (to be centered) 
exponential distribution with parameter 2c. This leads in particular to an optimal 
inequality 12611 . 

Keeping (f>{x) = x, let c(x) be a non-negative, continuous function. The setup 
was treated by Dubins, Shepp and Shiryaev and by Peskir in a series of articles 
f|15|. Peskir treated the case of real diffusions, which allows to recover 

the solution for general ^ as a corollary. 

Theorem 1 (Peskir |15p. The problem of maximizing £|J) over all stopping times 
t satisfying for </>(x) = x and c(x) a non-negative, continuous function, has an 
optimal solution with finite payoff if and only if there exists a maximal solution g* 
of J 

9 ' {S) = 2c(g(8))(8-g{s)) (3) 

which stays strictly below the diagonal in R 2 . The Azema-Yor stopping time r„ = 
inf{i > : B t < <?*(S' t )} is then optimal and satisfies {^) whenever there exists a 
stopping time which satisfies JH) . 

As pointed out above, this theorem was proved in a setup of any real, regular, 
time- homogeneous diffusion to which we will come back later. The characterization 
of existence of a solution to Q through existence of a solution to the differential 
equation © is called the maximality principle. We point out that Dubins, Shepp and 
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Shiryaev, who worked with Bessel processes, had a different way of characterizing 
the optimal solution to namely they required that 3±isl > \_ 

s s—*oc 

Let now <j> be any non-negative, non-decreasing, right-continuous function such 
that <f>(Bt) — ct is a.s. negative on some (to, oo) (with to random) and keep c constant. 
This optimal stopping problem was solved by Meilijson |1U| . Define 

H(x) = sup E \(j>(x + S T ) — cr . 



Theorem 2 (Meilijson |10|L Suppose that E sup t {<^(_Bt) — ct} < oo. Then H is 
absolutely continuous and is the minimal solution to the differential equation 

H(x)--L(H'(x)) 2 = ( b(x). (4) 

If <f) is constant on [xq,oo) then H is the unique solution to that equals (f> on 
\xq,oo). The optimal stopping time r* which yields H(0) is the Azema-Yor stopping 
time given by r* = inf{t > : B t < St — H 1^ }■ 

Let us examine in more detail the result of Meilijson in order to compare 
it with the result of Peskir. The Azema-Yor stopping time is defined as r* = 
inf{i > : Bt < g(St)} with g(x) — x — H S X * . Let us determine the differen- 
tial equation satisfied by g. Note that H is by definition non-decreasing, so we have 
H'(x) = \/Ac^/ (H(x) — (/>(x)). For suitable (j), this is a differentiable function and 
differentiating it we obtain 

H „ = 2c(H'(x) - <P'(x)) = 2c(H'(x) - 4f{x)) 
y/4c(H(x) - Wf) H '( x ) 

> (x] i H"(x) <P'(x) t'(x) 
9(X) - 1 2c ~ H'{x) ~ 2c(x - g(x)) ' W 

We recognize immediately the equation © only there <f>'(s) — 1 and c was a function 
and not a constant. This motivated our investigation of the generalization of problem 
Q, given in If 21 . which is solved in Theorems |S|-[7| in Section 0] 

Consider now the converse problem. That is, given a centered probability mea- 
sure fx describe all pairs of functions (</>, c) such that the optimal stopping time r*, 
which solves Q exists and embeds fi, that is _B Tfl ~ fi. 

This was called the "optimal Skorokhod embedding problem" (term introduced 
by Peskir in as we not only specify a method to obtain an embedding for fi but 

also construct an optimal stopping problem, of which this embedding is a solution. 

Again, let us consider two special cases. First, let <f>(x) = x. From the Theorem 
Qwe know that r* is the Azema-Yor stopping time and the function g* is just the 
inverse of barycentre function of some measure \x. The problem therefore consists 
in identifying the dependence between [i and c. Suppose for simplicity that \i has a 
strictly positive density / and that it satisfies L log L-integrability condition. 

Theorem 3 (Peskir |1B|L In the setup above there exists a unique function 



Therefore 



(6) 
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such that the optimal solution r* of QJ) embeds /i. This optimal solution is then the 
Azema-Yor stopping time given by 

r, =M{t > : S t > ¥p(B t )}, where (7) 

M*) = n 1 u / vMv)- (8) 

The function c in (|SJ is recognized as a half of the hazard function which plays an 
important role in some studies. Now let c(x) — c be constant. Then we have 

Theorem 4 (Meilijson |10|). In the setup above, there exists a unique function <j) 
defined through ^|) with H'(x) — 2c(x — <P^ 1 (x)), where is the barycentre function 
given in fM . such that the optimal solution r* of t HUt embeds fi. This optimal solution 
is then the Azema-Yor stopping time given by 

We will provide a general solution that identifies all the pairs ((f), c) with basic 
regularity properties, in Proposition |5] in Section |S] 



2 Notation 

In this section we fix the notation that, unless stated otherwise, is used in the rest 
of the paper. 

X — (Xt)t>o denotes a real-valued, time-homogeneous, regular diffusion associ- 
ated with the infinitesimal generator 

, d o- 2 (x) d 2 

where the drift coefficient x — + S(x) and the diffusion coefficient x — > o~(x) > are 
continuous. We assume moreover that there exists a real- valued, standard Brownian 
motion B — (B t )t>o, such that X solves the stochastic differential equation 

dX t = S(X t )dt + a(X t )dB t , (10) 

with Xo = x under := P for x G R. The natural filtration of X is denoted 
(J~t : t > 0) and is taken right-continuous and completed. The scale function and 
the speed measure of X are denoted respectively by L and by m. The state space of 
X is (ax, bx), where ax < bx can be finite or infinite. The interval (ax, bx) might 
be also closed from one, or both, sides under some additional conditions, as will be 
discussed later. We recall, that for Brownian motion L(x) = x and m(dx) = 2dx. 
The one-sided maximum process associated with X is 

St=( Sup X r ) VS (II) 

^ 0<r<t ' 

started at s > x under P„, lS := P. When several maximum processes will appear for 
different diffusions, we will add appropriate superscripts, thus writing . The first 
hitting times for S are noted T a = inf{t > : St > a}. 
We make the following assumptions on the function 4>: 
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• 4> ■ (ax,bx) — > R is non-decreasing, right-continuous and its points of disconti- 
nuity are isolated; 

• 4>' , taken right-continuous, is well defined and its points of discontinuity are 
isolated; 

• there exists r$, such that on [r^ — 1, +00), tf> £ C 1 and <j)' > ; 

The last assumption has technical signification and is there to allow for a convenient 
identification of a particular solution to a differential equation. It will be clear form 
our proofs of main theorems, we hope, that one could impose some other condition, 
which would yield a different description. 

We denote D^, the set of points of discontinuity of (f>. It is bounded from above 
by and can write = {do, di, . . . } where d; > di+i. Similarly, the set of points 
of discontinuity of <j>' is also bounded from above by and we can write D^i = 

U {/o, fx, ...}, where f t > f i+1 . 

It will be convenient to work sometimes with a different function <f>, which is of 
class C with <f>' > 0, and satisfies: <f> < <f>, tfii — 4>\ . No reasoning will 

depend on a particular choice of 4>, so we do not present a specific construction. 

The function c : [0, +00) — > [0, +00) has a countable number of discontinuities. 
In his work Peskir 115) supposed c > 0, but we will see (cf. Remark |SJ that allowing 
c to be zero on some intervals can be of great use. In some parts of the work we will 
make additional assumptions on the regularity of c, yet in others we will allow it to 
take the value +00. 

We consider the following optimal stopping problem: 



Through a solution to "the optimal stopping problem 112H " we understand a stop- 
ping time which yields V* and satisfies the condition (11311 . Such solution is denoted 
t* , i.e. V* (x, s) = M x ,s y4>(S Tt ) ~ Jq* c(X t )dtj . Note that of course V* and r* depend 
on 4> and c but it will be obvious from the context if we discuss the general setup of 
arbitrary (</>, c) or some special cases. 

3 Some remarks on the problem 

In the next section we will present a complete solution to the optimal stopping 
problem 1121 . However, before we do it, we want to give some relatively simple 
observations, which help to understand better the nature of the problem. Most of 
them become nearly evident once a person is acquainted with the problem, yet we 
think it is worthwhile to gather them here. As a matter of fact, they will help us a 
great deal, both in formulating and in proving, the main results of this paper. 

The general construction of the optimal stopping problem under consideration 
is such, that we get rewarded according to the record-high value so far, and get 
punished all the time, proportionally to the time elapsed and depending on the 




(12) 



where r is a .^-stopping time, which satisfies 




(13) 
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path of our process. This means basically that the situation when the diffusion 
increases is favorable and what is potentially dangerous, as it might be "too costly", 
are excursions far away below the maximum, that is the negative excursions of the 
process (Xt — St)- The first observation is then that we should not stop in the support 
of dSt. 

Remark 1 (Proposition 2.1 If <t> > and r yields the solution to the problem 

112H . then X T ^ SV a.s., that is the process (X t ,St) cannot be optimally stopped 
on the diagonal of R 2 . 

Let us investigate in more detail the nature of the optimal stopping time. If we 
follow the process Xt, as noted above, we gain when it increases. In contrast, when 
it decreases we only get punished all the time. This means that at some point it 
gets too costly to continue a given negative excursion of (Xt — St)- Exactly when 
it becomes too costly to continue the excursion depends only on three factors: the 
diffusion characteristics, the functions <f>, and c, and on the value St of the maximum 
so far. Indeed, the choice of the point in an obvious manner depends on what we 
expect to earn, if the process climbs back to St, which in turn is a function of the 
diffusion characteristics and the functions <j), and c. Note however, that through the 
Markov property, it doesn't depend on the way the process arrives at St- Similarly, 
thanks to the Markov property, the way the excursion of (X — S) straddling time 
t develops, doesn't affect the choice of the stopping value. Clearly also this value is 
an increasing function of the maximum. 

Remark 2. The solution to the optimal stopping problem 1121 . if it exists, is given 
by a stopping time of the following form r = inf{t > : X t < g*(St)}, where 
the function is non-decreasing and depends on the characteristics of X and the 
functions <f>, and c. 

Now that we have a feeling of how the stopping time looks like, we will try to 
learn more about the function g,. Consider the function V(x, s) given by (1121 . Since 
V(x, s) corresponds to the optimal stopping of the process (Xt, St) started at (x, s), 
the values of <f>(u) for u < s never intervene. Furthermore, if the process reaches 
some value si > s then, thanks to the strong Markov property, we just face the 
problem V(s\,si). We could then replace the function (f> with some other function 
<f) which coincides with <f) on [si,oo) and this would not affect the stopping rule, 
that is it would not affect values of the function g, on the interval [si,oo). Thus 
the finiteness of V is not affected by any change of <j> away from infinity. Likewise, 
if we add a constant 5 to (f> it will only change V(-, ■) by 5 and leave unchanged. 
Combining these observations we arrive at the following remark. 

Remark 3. Consider two functions cj>i and <f>2 which, up to an additive constant, 
coincide on some half- line: (j>i(s) = (j>2 (s) + 8 for all s > r and some 8 £ R. The 
optimal stopping problem 11121 for 0i has finite payoff if and only if the optimal 
stopping problem 1121 for (f>2 has finite payoff. Suppose this the case and denote 
respectively n = mi{t > : X t < gl(S t )} and r 2 = inf{t > : X t < gi(S t )} the 
stopping times, which yield these payoffs. Then gl(s) — g*(s) for all s > r. 

We turn now to examine in more depth the relation between g, and (f>. Consider an 
interval of constancy of (f>. Suppose that (f)(a) — <f>(/3) for some a < /3 and <f) increases 
on right of [3 (or has a jump). Then starting the process at a; £ [a, f3) we face always 
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the same problem: we get punished all the time, but get rewarded only if we attain 
the level j3. Due to the Markov character of the diffusion, reasoning similarly to the 
derivation of Remark we see that the optimal stopping time is then just an exit 
time of some interval [j,0\ and 7 is then precisely the value of g, on (a,/3). 

Remark 4- The functions (f> and g,, which induces the optimal stopping time, have 
the same intervals of constancy. In other words g' r \ = <4> <f/\ = 0. 

It is important to realize that if an interval of constancy of <f> is long and the function 
doesn't grow fast enough afterwards, it may be optimal to stop immediately when 
coming to such a level of constancy. Thus the function g* may stay in part under 
and in part on the diagonal in R 2 . 

Analysis of jumps of 4> and g* is more involved. When (f> is continuous, since the 
diffusion itself is continuous too, it's not hard to believe that g* should be continuous 
as well. It is maybe a little more tricky to convince yourself that if <j) jumps, then 
<7* has a jump too. We will try to argue this here, and moreover we will determine 
the height of the jump, following the reasoning of Meilijson developed in the proof 
of Corollary 1 in |1U|. Suppose that <j> has a jump in so: <f>(so) — <f>(so—) = j > 0. 
For simplicity, suppose also that <f> is constant on some interval before the jump: 
<f)(so — e) = ((>(sq—). Then, as noted above, starting the process at some x € [so — e, so) 
we wait till the first exit time of the interval [g*(x), so]. If we exit at the bottom we 
stop, and if we exit at the top, we have a new, independent diffusion starting, for 
which the expected payoff is just V(so,so). For the process X staring at y £ [a,b], 
denote p y a b and p v a respectively the first exit time of the interval [a, b] and the first 
hitting time of the level a. We can then write the payoff V(x,x) as 

V(x,x) = E [v(so,s )1 {pU ^ 3q=p * o} +4>(x)l {pUxh3Q=pUx)} 

c{X u )du\. (14) 

We know, by Remark|3] that the value g*(so) is uniquely determined by the diffusion 
characteristics, the cost function c, and values of the function <f) on [so, 00). Replace 
in the above display g*(x) by a and denote this quantity V a (x,x). Then V{x,x) = 
sup a<S() V a {x, x). This determines the value of a% = g*(x) and therefore the height 
of the jump of g* at so. We will now show that the value of a% does not depend on 
x (which is also clear by Remark and give an equation which describes it. 

Actually the equation for a% is obvious: a% is the unique real, such that 
dV aa' X ^ 1 ~ 0" This can be rewritten in the following equivalent manner, us- 
ing the fact that P(p* b = pf) = (L(x) - L(a))/{L(b) - L(a)): 

We just have to show that actually a J does not depend on 1. To this end let a < 
y < x < so and write 
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E a ' S ° c(X u )du\ = E [J o "° c(X u )du x lpx sg = P * o 
+ J y c(X u )du x lp ?i , o = P g] 

where we used the strong Markov property at time Py. The first two terms on the 
right-hand side do not depend on a, and differentiating the above equation with 
respect to a yields an identity which proves that aj = at =: a» for x,y € [so — e, so), 
since <j> was supposed constant on this interval. It is also clear that a* depends only 
on the characteristics of X, the cost function c and the payoff value V(so, so). Since 
the diffusion is fixed, we write a* = a»(c, V(so, so)). 

So far we only analyzed the dependence between <?* and (f>, and it is the time to 
investigate the role of the cost function c. Suppose that the function c disappears on 
some interval, c\. . = 0. Thus wandering away from the maximum in the interval 
(q, (3) doesn't cost us anything - there is no reason therefore to stop while in this 
interval. This implies that (a, /3) is not in the range of g*. 

Remark 5. If cl = end r* yields the optimal payoff to the problem 11121 . then 
(a, /3) n g»(R) = and X T , f (a,j3) a.s. 

Thus, the impacts of the intervals of disappearance of c, and of the jumps of <j>, on 
the function g,, axe similar, only the former is much easier to describe. One could 
predict that the jumps of c would provoke a similar behavior of g* as do the intervals 
of constancy of <f>. This however proves to be untrue. It stems from the fact that 
the values of c are averaged through integrating them. Thus, jumps of c will only 
produce discontinuities of gi. We will come back to this matter in Theorem HJ 



4 Maximality principle revisited 

In this section we describe the main result of our paper, namely the complete solution 
to the optimal stopping problem 11211 . The solution is described in a sequence of 
three theorems with increasing generality of the form of the function (f>. In the first 
theorem we suppose that 4> is of class C 1 and strictly increasing. Our theorem is 
basically a re-writing of the Theorem 3.1 found in Peskir |15| . Theorem |S] treats the 
case of a continuous function cf>, and is obtained form the previous one through an 
approximation procedure. Theorem |7| which deals with the general setup described 
in Section |21 It relays on Theorem |5] and on the work of Meilijson |10|. and is less 
explicit then Theorems and |S| as the treatment of jumps of <f) is harder. 

Theorem 5 (Peskir). Let <f> £ C 1 with (j>' > 0, and c > be continuous. The 
problem UiH) . has an optimal solution with finite payoff if and only if there exists a 
maximal solution g t of 



(16) 
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which stays strictly below the diagonal in (ax, bx) 2 (i.e. g*(s) < s for ax < s < bx )■ 
More precisely, let s* be such that g*(s*) = ax- Then g* satisfies 1166 on (s,,bx) 
and it is maximal such function (where the functions are compared on the interval, 
where both of them are superior to ax ), which stays below the diagonal. 
In this case the payoff is given by 

V*{x,s) = (f>(s)+ ( (L(x) ~ L{u))c(u)m(du), (17) 

JxAg*(s) 

The stopping time r* = inf{£ > : Xt < g*(St)} is then optimal whenever it satisfies 
1136 . otherwise it is "approximately" optimal 2 . 

Furthermore if there exists a solution p of the optimal stopping problem 1126 then 
Pi, s (t, < p) = 1 and r* satisfies 1136 . 

If there is no maximal solution to 1166 . which stays strictly below the diagonal in 
K 2 , then V„(x,s) = oo for all x < s. 

The last property for r* says it's pointwise the smallest solution, providing a unique- 
ness result. This remains true in more general setups and we will not repeat it below. 
This property follows from Peskir's |15| arguments but is also closely linked with 
properties of the Azema-Yor stopping times, or any solutions to the Skorokhod em- 
bedding in general, we refer to Obloj pill , chapter 8, for details. Note that for a 
general <f>, we defined in Section [5] the function <f>, which coincides with cj> on the 
interval [r$, oo) and is of class C . In particular, we can apply the above theorem to 
the optimal stopping problem 1121 with <j> replaced by (j>. We denote g, the function 
which gives the optimal stopping time f = inf{t > : Xt < g*(St)}, which solves 
this problem. 

Theorem 6. Let (j> be as described in Section^ but continuous, and c > be con- 
tinuous. Then the optimal stopping problem 1126 has a finite payoff if and only if 
the optimal stopping problem with <j> replaced by (j> has a finite payoff. In this case 
there exists a continuous function g,, which satisfies the differential equation \1 61) 
on the interior of the set M.\D r / ) i , and coincides with g* on the interval [r^,oo). 
The payoff is given by the formula \ll6 and is obtained for the stopping time 
t — hif{i > : X t < g*(S t )}, if it satisfies 1136 . Otherwise this stopping time 
is approximately optimal. 

It is important to note, that the function g* may not satisfy anymore g, (s) < s, since 
if the constancy intervals of <j> are too long it might be optimal to stop immediately 
(see also discussion around Remark gj. 

The formulation for the case of 4> with discontinuities is somewhat more techni- 
cal, as we have to define g* through an iteration procedure. 

Theorem 7. Let <f> be as described in Section and c > be continuous. The 
optimal stopping problem 1126 has finite payoff if and only if the optimal stopping 
problem with 4> replaced by cj> has a finite payoff. In this case there exists a function 
g t , continuous on the set R\D^, which satisfies the following: 

• g,(s) = g,(s) for all s e[r<t,,oo); 

2 In the limit sense as in Peskir |15|. 
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• g, is continuous on the interior of the set R \D$ and differentiable on the interior 
of the set M.\Dj,i, where it satisfies the equation I lot) : 

• for all s £ D^, a* = g*(s— ) satisfies the equation I J 51) with so = s. 

The payoff is described via 

It is important to note, that even though the optimal payoff V appears in the 
equation (11511 the above construction of g, is feasible. Recall, that the jumps points 
were denoted ... < d\ < do- When determining the value of g* (di—) we already know 
the values of g* on [di, oo) and through the formula 11711 also the payoff V(x, s) for 
di < x < s. 

Proof. We now prove, in subsequent paragraphs, Theorems [S] [(J and [7| 
Theorem [3| Step 1. We start with the case when the state space of the dif- 
fusion X is the whole real line, (ax,bx) = R, and the function (f> is strictly 
increasing and of class C , and its image is the real line <f> : R ^5 R. Let 
Yt — 4>(X t ). It is a diffusion with the scale function L Y (s) = L(^ _1 (s)), the 
drift coefficient 8 Y \y) = $'(4>-\y))5($-\y)) + \<t>" ' (y))o 2 \<tr x (y)) , the dif- 
fusion coefficient a Y (y) — 0'(0 — 1 (j/))cr(0 — 1 (y)) and the speed measure m Y (dy) = 

V77-7 — 1 1 ss,,,? d i, „ 77-7 — r~t — v\ • The state space of Y is the whole real line. We can 

L'(<t> 1 Cw)9 (y)) CT (p (sO) 

rewrite the optimal stopping problem for X in terms of Y (where we add super- 
scripts X and Y to denote the quantities corresponding to these two processes): 

V t x (x,s) = supE^ (<£(£?) ~ ^ c(X t )di) 

= supE,,, (s^ - j* c(^- 1 (y t ))dt) (18) 

= V, Y (</>(x), (j>(s)) under (j> = Id and £ = c o <fT x . 

We see therefore that the optimal solution for X coincides with the optimal 
solution for Y for a different problem. We can apply Theorem 3.1 in Peskir [15] for 
this new problem for Y to obtain that the optimal solution, if it exists, is given by 

r* = inf{t > : Yt < gl(SY)} 

= inf [t > : X t < -1 (ffrfa(Sf )))}, (19) 

where g Y is the maximal solution which stays below the diagonal of the equation 

r' (s) = ^(r 1 (gr( g ))) 2 0- l '(gr(^)a 2 (r 1 (gr( S )))^(r l (gr( g ))) 



2c{^(gY(s))) (L(^(s)) - L(ct>-Hg?(s))) 

We put g x (s) — (j>~ 1 yg Y (</>(s))J , so that the existence of is equivalent to the 
existence of g Y . We will now show that g* satisfies the equation (1161 . We will use the 
following simple observations: </> _1 (0(s))0'(s) = 1 and ^ — = <f>'(g x (s)). 

g*\s) = ^'(gZWs))) x g? (</>{*)) x 

^ 1 \g Y (^s)))\^\g x (s)))\ 2 (g x { S ))L'{g x {s))4> , {s) 



2c{g?(s)){L(s)-L(g?(s))) 
^(s)a 2 (g x (s))L'(g x (s)) 



2c(g?(s))(L(s)-L(g?(s))) 
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in which we recognize (11611 . Note that (g£ (s) < s for s G RJ (#r( s ) < s f° r 
s 6 l) as (ff^( s ) < s) <4> ((j^(<^(s)) < (fi( s )) and ^ is a one to one map from R to 
R. This yields the description of g* as the maximal solution to 1161 . which stays 
strictly below the diagonal in R 2 . 

The expression for payoff follows also from Peskir |15| by a change of variables. 
Step 2. In this step we extend the previous results to the case, when the diffusion 
X or the function <fi are not unbounded. First, observe that the results of Peskir 
work just as well for a diffusion with an arbitrary state space (ax, bx), — oo < ax < 
bx < oo. Indeed, if we take <j> = Id, the solution is given by the maximal solution 
to the equation 11611 for s G (ax, bx) and which stays strictly below the diagonal in 
(ax, bx) 2 ■ Formally, we could repeat the proof in of Theorem 3.1 in |15| . in about the 
same manner that Peskir treats non-negative diffusions in Section 3.11 in the same 
article. Moreover, in this section, Peskir also discusses the boundary behavior, to 
which we will come below (notice that so far we considered unattainable boundaries, 
see Karlin and Taylor pp. 226-236]). 

We conclude therefore that the assumption on the state space of the diffusion, 
as well as on the range of cfi, were superficial. We need to keep <fi' > 0, but we can 
have </>(R) C R. Note that <f>(R) is then an open interval <f)(R) = (a,b). The equation 
I2UH is valid in (a, b), but the original one 1161 is valid in (ax,bx) as asserted, due 
to the fact that — (fi^ 1 o gl o cfi. The assumption, that (f> is strictly increasing is 
needed for the new process to be a diffusion. We now turn to more general cases, 
which will be treated by approximation. 

Theorem We extend the previous results to functions (j>, which are just non- 
decreasing and continuous. This is done through an approximation procedure. 
Let 4> n be an increasing sequence of strictly increasing C 1 -functions, converging to 
<j>, such that <j>' n — > <f>', and <fi n \ [r^ .oo) = </>|[r,i,oo)- Note V n and V the payoffs given 
in I12L under the condition 1131 1. for functions <fi n and <f> respectively. Obviously 
V n < V n +i < V . Furthermore, from Remark|3|it follows that the payoff V is finite if 
and only if all V„ are finite. Suppose this is the case. We know, by Theorem Improved 
above, that V„ axe given by a sequence of stopping times r™, r" = inf{t > : Xt < 
g" (St)}, where g" are denned as the maximal solutions of 116H . with <f) replaced by 
(fi n , which stay below the diagonal. It is easy to see that t" < r t n+1 and therefore 
9* > 9* +l ■ This is a direct consequence of the fact that in the problem I12H the 
reward (4>„(S T )) increases and the punishment (J Q r c(X s )ds) stays the same. It can 
also be seen from the differential equation 11611 itself. We have therefore r" f r* 
a.s., for some stopping time r*, which is finite since the payoff associated with it is 
finite, V < oo. Moreover, r* = inf{t > : Xt < g,(St)}, where g" \ g,. Note that 
the limit is finite and satisfies g*(s) < s. Furthermore, we can pass to the limit in 
the differential equations describing g" to see that satisfies 116H . Note that this 
agrees with Remark^] Suppose that the stopping time r* satisfies 113H . We then see 
in a straightforward manner, that t* solves the optimal stopping problem for <fi. It 
suffices to write: 
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E*, s (4>(S T .) - jT* c(X t )dtj < V,(x,s) (21) 

= supE x , s (</>(S T ) - J c(X t )dt) 
< lim sup E x , a (V„(S T )- / c(Xt)d^ 
= lim E x a (MSt?)- [ * c(Zt)df) 
= E X , S (<KS T .)-J " c(Xt)dt), 

where passing to the limit in both cases is justified by the monotone convergence of 
4>n y 4> and r" f t* a.s.. The expression for payoff given in 117H follows also upon 
taking the limit. 

If the stopping time r* fails to satisfy 113H . we proceed as Peskir 1151 p. 1626], to 
see that the expression 1171 for payoff remains true (and we say r* is approximately 
optimal as it is in fact a limit of stopping times satisfying (EJ)- 

Theorem^ All that has to be verified is the expression for gr»(di— ), i > 0, where 
— {do, di, . . .}. Obviously, it is enough to discuss one jump, say do- The proposed 
value for g(do-) is just the value we obtained at the end of Section We had 
however an assumption that <j> was constant on some interval [do — e, do) and we 
need to argue that it can be omitted. This is done by approximating (f>. Define <j> n 
through 4> n {s) — 4>{s) for all s G R\[d — ^j^o) and (j>„ constant and equal to 
4>{do—) on [do — ^,do). The theorem then applies to functions cj> n , as by Remark|3| 
the finiteness of the payoff for (j>, $ and (f> n are equivalent. Passing to the limit, as 
in the proof of Theorem above, yields the result. Seemingly, taking a sequence of 
continuous functions <f> n increasing to <f> and repeating the reasoning in 12 U we see 
that the payoff equation 11711 is still valid. 

Note that g,(bx) =bx- It is evident when the state space is (ax,bx], since we 
have to stop upon achieving the upper bound for the maximum S, as continuation 
will only decrease the payoff. Generally, if g*(bx) = ft < bx (understood as limit 
if necessary), then as St — > bx, the possible increase of payoff goes to zero but the 
cost till stopping doesn't. 

The value of at ax depends on the boundary behavior of X at ax- Peskir |15| 
dealt with this subject in detail. He considered the case ax = 0, as it was motivated 
by applications, but this has no impact on the result. We state briefly the results 
and refer to his work for more details. When ax is a natural or exit boundary point, 
then g,(ax) = lim s j ax <7*( s ) = a x ■ In contrast, when ax is an entrance or regular 
instantaneously reflecting boundary then g*(ax) = lim s | ax g*{ s ) < ax- 



5 General optimal Skorokhod embedding problem 

In this section we consider the so-called optimal Skorokhod embedding problem. The 
general idea is to design, for a given measure fi, an optimal stopping problem with 
finite payoff, such that the stopping time which solves it embeds fj,, i.e. X T ~ y,. We 
choose here to restrain ourselves to the classical setup of Brownian motion, X — B. 
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Study for general diffusions is equally possible, only the formulae would be more 
complicated and less-intuitive. In principle however it is not harder, since we know 
very well how to rephrase the classical Azema-Yor embedding for the setup of any 
real diffusion (Azema and Yor Cox and Hobson see Obloj |11| for a complete 
description of the subject). 

This problem was first introduced in the context of classification of contingent 
claims, where the measure /i had an interpretation in terms of risk associated with 
an option (see Peskir |171). Peskir in his article on the optimal Skorokhod embedding 
16 gave an explicit solution, but he assumed for simplicity that the measure /j, had 
positive density on R. One could think that this will generalize easily to arbitrary 
measures. Unfortunately this proves not to be true. In the setup when (f)(x) = x, it 
is not possible to solve the optimal embedding problem for a measure, which has an 
atom in the interior of its support. To see this, note that the presence of an atom 
in the interior of the support implies that the barycentre function has a jump, 
which in turn means that the function = iP - ^ 1 has to be constant on some interval. 
However, the derivative of g is given by g'{s) = [2c(g(s))(s — g(s))]~ 1 which is strictly 
positive. In this sense, it is the presence of the function <f) which proves fundamental 
to solve the problem. Meilijson |10|. who had c(x) = c but arbitrary <f), solved this 
problem for any centered measure [i with finite variance, but his solution is not 
really explicit. We will see that actually to obtain a general explicit solution, both 
function c and <j) are needed, as the former allows to treat the regular (absolutely 
continuous) part of a measure, and the latter serves to obtain atoms. 

We set ourselves two goals. Firstly, for a given measure fi, we want to identify 
all the pairs (<f>, c) such that the optimal stopping time t* which solves (1121 embeds 
H in B, B Tt ~ fj,. We are interested in stopping times r» such that (Bjat, : t > 0) 
is a uniformly integrable martingale. This limits the class of measures which are 
admissible to /i such that J R \x\d/j,(x) < oo and f R xdjj,(x) — 0. Our second goal is to 
give a particular explicit description of a particular pair (0, c). 

Let us start with the case of a measure [i with a positive density / > on I. 
Then, we know that for t» = inf{t > : Bt < g*(St)} we have B Tt ~ /i if and only 
if <?*(s) = $ r ^ 1 (s), where 'P^ 1 denotes the inverse of "f^. This is a direct consequence 
of the Azema-Yor embedding 2 and the fact that g is increasing with g(s) < s. Let 
us investigate the differential equation satisfied by W^ 1 . Using the explicit formula 
JHJ, we obtain 



{s-^\s))f{^\s)Y (22) 

Comparing this with the differential equation for g„ given by 1161 . we see that we 
need to have 

4>\s) _ Ti{9? {a)) 



Equivalently, we have 



2c(^- i ( S )) m^{s)) 



(23) 



2c(u) f(i 



for it G R . (24) 



Finally, we have to ensure that the payoff is finite. This is easy since we want E 0(5' T , ) 
to be finite and we know that 5V„ = (B Tt ) , which implies that we need to have 

</>0Ma;))dM(z) < oo. (25) 
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We have thus obtained the following proposition: 



Proposition 8 Let [i be a probability measure on K with a strictly positive density 
f. Then the optimal stopping problem I12t has finite payoff and the stopping time 
t*, which yields it embeds /i in B, i.e. B Tt ~ /j, if and only if(<j>,c) satisfy {24t and 
i'H5\ ) for all s > 0. The stopping time t* is then just the Azema-Yor stopping time 
given by 

Note that, if we take <j>(s) — s so that (j>'(s) = 1 we obtain a half of the hazard 
function for c, which is the result of Peskir, stated in Theorem |3 The integrability 
condition 1)25(1 then reads J <L , tJ ,(x)dfi(x) < oo, which is known (see Azema and Yor 
PP) to be equivalent to the L log L integrability condition on x log xd\i(x) < oo. 

Proof. In light of the reasoning the led to 124H all we have to comment on is the 
continuity of the function c. Theorems l5l7l were formulated for a continuous function 
c > 0. Here, keeping the condition c > 0, we drop the assumption on continuity. 
Still, this is not a problem. It suffices to take a sequence of functions c n \ c a.e. and 
proceed as in the proof of Theorem HJ around 121II . to see that the function g*, which 
yields the solution r* = mi{t > : B t < g,(St)} to the optimal stopping problem 
11211 . satisfies locally the equation 11 (it and is continuous. This in turn implies that 
it is indeed the inverse of the barycentre function associated with /x. 

Identifying all pairs (0,c), which solve the optimal Skorokhod embedding prob- 
lem for an arbitrary measure is harder. More precisely it's just not explicit any more. 
The reason is hidden in Theorem Q- the description of jumps of g. t , which corre- 
spond to intervals not charged by the target measure, is done through an iteration 
procedure and is not explicit. This is exactly the reason why Meilijson was only able 
to prove the existence of the solution to the optimal Skorokhod embedding without 
giving explicit formulae. In our approach we will use the duality between <f> and c to 
encode explicitly both the jumps and the regular part of the target measure. Still, 
we will not be able to cover all probability measures. 

Let fj.be a, centered probability measure J R |a;|d/i(:E) < oo, L xdfi(x) = and note 
— oo < a M < b M < +oo respectively the lower, and the upper, bound of its support. 
Suppose /i is a sum of its regular and atomic parts: /i = /J, r + (J, a , dfi r {x) — f(x)dx 
and n a = X^gzP^ii- ^ n other words / is the density of the absolutely continuous 
(with respect to the Lebesgue measure) part and • ■ • < j-i < jo < ji < ■ ■ ■ are 
the jump points of (i, which are also the jump points of the barycentre function 

<^ M , so that <^ M (R) = 

"vw + M(a»7+tx,)) • 

Theorem 9. In the above setup, in the case when f > or f > but fi a = 0, the 
optimal stopping problem 112\) with 

c r x ) = [4m >f° rx £ KM and (<t>'ix) = i^ m (x), 

1 +oo , for [a M , 6 M ] \ <\> continuous, (f>(0) = 

has finite payoff under I25\l . The payoff is realized by the Azema-Yor stopping time 
t» = int{t >0:S t > %(B t )} and B T , ~ p. 



\(U ie z (* r M(jO-^(j l +)]). We may note that <Pfl(ji+) 
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Note that the condition 4>(0) = is just a convention, as adding a constant to cf> 
doesn't affect the solution t» of 11211 (cf. Remark|^J. The restriction 12511 . thanks to 
the definition of <j>, is satisfied in particular when J ^ r ll (x)dfi(x) < oo, that is if fj, 
satisfies the LlogL integrability condition. 

Proof. The problem arising form discontinuity of c is treated exactly as in the proof 
of Proposition [S] above. In the case of / > on R the above theorem follows imme- 
diately from Theorem |S] If yt has no atoms, then S^(ffi) = K+ and so (j> = Id. From 
the differential equation 1161 we can derive a differential equation for the inverse 
of <?, , from which it is clear that we can treat intervals where c is zero by passing 
to the limit. Thus, our theorem is also valid in the case of absolutely continuous 
measure but with a density which can be zero at some intervals. Finally, the case of 
atoms with limsup,^^ j„ = +oo is also handled upon approximating and taking 
the limit. Indeed this does not bother us here as we do not need anymore to describe 
the limiting solution through a differential equation, as was the case for Theorems 

mm 

Unfortunately, our method does not work for an arbitrary measure {i. If one tries to 
apply it for a purely atomic measure, he would end up with ^ecsO.Ih fact, when 
there is no absolutely continuous part we need to take <j> discontinuous, as Meilijson 
does. We are not able to solve the problem explicitly then. We cannot treat measures 
with singular non-atomic component. 



6 Important inequalities 

In the above section we saw how the solution to the optimal stopping problem yields 
a solution to the so-called optimal Skorokhod embedding problem. This actually 
motivated our research but is by no means a canonical application of the maximality 
principle. Probably the main and the most important applications are found among 
stopping inequalities. We will try to present some of them here. A specialist in 
the optimal stopping theory will find nothing new in this section and can probably 
skip it, yet we think it is useful to put it in this note, as it completes our study 
and allows us to give some references for further research. The main interest of the 
method presented here, is that the constants obtained are always optimal. Some 
of the inequalities below, as 13011 . are easy to obtain with 'some' constant. It was 
however the question of the optimal constant which stimulated researchers for a 
certain time. 

Consider a continuous local martingale X = (X t : t > 0) and a stopping time T 
in the natural filtration of X, T < oo a.s. We have then 

ESt < JexI, where Sf = sup X s , (26) 

* ' s<t 

and this is optimal. This simple inequality was first observed by Dubins and Schwarz 
0. It can be easily seen in the following manner (localizing and passing to the limit 
if necessary): E St — E[S T - X T ] < ^/E[S T - X T f = s/E[X%], where we used 
the fact that (St — Xt) 2 — X 2 is a local martingale (see Oblqj and Yor |12) for 
various applications of these martingales). This inequality is optimal as the equality 
is attained for T = inf{t > : S* — X t — a} for any a > (Xt has then shifted 
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exponential distribution with parameter -). If we want to establish an analogous 
inequality for \X\, that is for a submartingale, some more care is needed. We propose 
to follow Peskir |1 41 115| in order to obtain more general inequalities. 

Consider the optimal stopping problem 1121 . with X = \B\ the absolute value of 
a Brownian motion, (f>(s) = s p and c(x) = cx p ~ 2 , where p > 1. We solve the problem 
applying Theorem Q>] The differential equation 1161 takes the form 

9 ' {S) = 2cg(s)P-\s-g(s)y (27) 

which is solved by g(s) = as, where a is the larger root of the equation q p_1 — 
oP = j^, which is seen to have solutions for c > p p+1 /2(p — lp p ~ l '. Taking c \ 
p p+1 /2(p- l)^" 1 ) yields 



E max \B T \ P < — E|B T | P , (28) 
V o<t<r 1 / \p — 1/ ' 1 

where r is any stopping time in the natural filtration of \B\ such that Er p ^ 2 < oo. 
Note that to obtain the right-hand side of the above inequality we used the fact that 
E (Jo" \ Bt \ V ~ 2 ) = p(p-i) ^\B T \ P ~ 1 . More generally we could consider the optimal 
stopping problem 1121 with <j)(s) — s p and c(x) — ex 9-1 for < p < q + 1, q > 0. 
Optimizing upon c Peskir 14 obtains 



E | 



( maxJB r | p j < 7 ;,,lE(y IBtl^ 1 ^) , (29) 

for all stopping times r of The optimal constant 7* 9 is given implicitly as 
a solution to an equation. In the case p = 1 it can be written explicitly, j* q = 

(g(l + q)/2) 1/(1+9) (r(2 + l/q)) q/{1+q) . This was obtained independently by Jacka 
[B] and Gilat 0. In particular we find 7*^ = \/2 which is exactly the value found 
by Dubins and Schwarz [Sj- If we consider the well-known bounds 

c p E (J o \Bt\ p ~ 2 dt^j < E ( max jB T | p ) < C P E [J \B t \ p - 2 dt^j, (30) 

where p > 1 and c p , C p are some universal constants, we see that the inequality 
1291 complements them for < p < 1, where 1301 wouldn't have much sense. Also, 
as pointed out above, the method presented here allows to recover the optimal 
constants. 

The inequalities given above are just a sample of applications of the method 
presented in this note. Peskir 1 151 . for example, develops also a L log L-type inequal- 
ities and some inequalities for Geometric Brownian motion. Although the method 
presented is very general it has of course its limits. For example it seems one could 
not recover optimal constants 3 a p and A p , obtained by Davis 0J, such that for any 
stopping time T 

E\B T \ P < A p ET p/2 , for <p < 00, and (31) 
a p ET p/2 < E\B t \ p , for l<p< 00, ET p/2 < 00. (32) 

3 These can be recovered using different methodology involving determinist time 
changing (see Pedersen and Peskir |13|). 
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The maximality principle deals with the maximum process and is an essential tool 
in its study. However the passage from the maximum to the terminal value is quite 
complicated and in general we should not hope that optimal inequalities for the 
terminal value could be obtained from the ones for maximum. 

Acknowledgment. Author wants to express his gratitude towards professors Goran 
Peskir and Marc Yor for their help and support. 
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